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METHOD AND SYSTEM FOR HYPERMEDIA BROWSER API 
SIMULATION TO ENABLE USE OF BROWSER PLUG-INS AND 
5 APPLETS AS EMBEDDED WIDGETS IN SCRIPT-LANGUAGE- 
BASED INTERACTIVE PROGRAMS 



CROSS-REFERENCE TO RELATED APPLICATION 

This application is a continuation of and claims the benefit of U.S. 
10 Provisional Application No. 60/1 15>502, filed January 11, 1999, the disclosure of which 
is incorporated herein by reference. 



BACKGROUND OF THE INVENTION 

The Interactive Content Paradigm 

15 Computer application paradigms go through a constant process of 

evolution. Fifteen years ago, personal productivity applications typically were text-based, 
ran in full screen mode, and each application tended to employ a unique set of user 
interaction commands. As multi-windowed graphical user interface systems became 
popular, applications developed for these environments began to adopt standard types of 

20 interface models, to minimize users' confusion as they switched back and forth among 
multiple open applications. As a result of feature competition among vendors, 
productivity applications built for these windowed environments began to grow larger 
and larger. Simultaneously, users began to demand easy transfer of data between 
documents created with various applications. This led to the creation of compound- 

25 document architectures, such as Microsoft's Object Linking and Embedding (OLE) 
system. OLE-based applications were designed from a document-centric mindset, 
allowing several large monolithic productivity applications to share a single document 
view and "trade off the graphical interface, so that the user wouldn't have to move his or 
her eyes away from the document being worked upon as each application was 

30 interactively activated (usually with a double click on a bitmap in the document) by the 
user. This model worked well enough when only a few major applications were involved, 
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and when the user was primarily interested in editing documents which would be printed 
for use. The growth of the Web, however, ushered in a new use for document files - as a 
direct tool for networked communications and information retrieval. 

The Web's new plug-in and applet technology created a new paradigm for 
5 application development. This new system focused on the document as a container for 
multiple small embedded program objects, rather than as the OLE-style task switcher of 
the Windows model. This new system also ushered in a new interaction paradigm, as 
well. The Web document became the primary application, with the document 
automatically choreographing the collection of document component data and the 
10 activation of the embedded applications necessary to present the user with a single and 
seamless interactive interface to the document's content. 

The UCSF/Eolas WAPI 

The Web-document-as-application model was first established at the 
University of California, San Francisco's Center for Knowledge Management. Their 

15 work, and their proposal for a standard Web API (WAPI), was described in the lead 

article of the February, 1996, issue of Dr. Dobb's Journal . This technology allowed the 
creation and use of "plug-in" applications that Web content authors could easily employ 
to dynamically extend the functionality of WAPI-enhanced Web browsers and Web pages 
at viewing time, without having to modify the actual browser code. Although WAPI did 

20 not, itself, become an industry standard, it inspired later commercial systems that went on 
to transform the entire computer software industry. 

The Netscape Plug-In API 

Essentially modeled upon the UCSF/Eolas WAPI, the Netscape browser 
plug-in API created a de-facto standard that has been implemented in all major browsers. 

25 This resulted in the subsequent development of hundreds of plug-ins that were then made 
freely available online, all of which conform to a standard architecture. The availability 
of such a large number of application components has made the very popular and 
powerful platform for application development. The Web document parsing model 
allows late binding of these application components, together with runtime fetching of 

30 component-specific data objects, thereby insuring that users can both always enjoy the 
latest improvements to component programs and always see the latest updates to 
embedded object data. It also allows application design to be independent of underlying 



computer system architecture. This has proven to be a very effective means for 
application integration with legacy software systems, proving very popular among 
corporate applications developers. 

Scripting Languages 

Modern scripting languages, such as Tcl/Tk, provide the ability to write 
text scripts which define interactive applications through run-time parsing of script files. 
Similar to the situation with Web pages, this type of architecture provides for late binding 
of application functionality through such runtime script parsing. Tcl/Tk provides a 
standard APIs for enhancing both the command set and widget set of the interpreter 
through interpreter extension that are loaded at runtime. Although this provides some 
advantages similar to those of browser plug-ins, there are not nearly as many widget 
extensions available as there are browser plug-ins. Furthermore, the interpreter extension 
mechanism did not make provision for late binding of component application code with 
application data, as the browser plug-in model does. 

What is Needed 

A system is needed that allows general program development systems to 
benefit from the large number of embeddable applications, in the form of browser 
plug-ins, that are available to easily expand the functionality of these development 
platforms at run-time, as well as to provide runtime binding of component logic with 
remotely-networked data objects. 

SUMMARY OF THE INVENTION 

The present invention provides these useful advantages through the novel 
and counterintuitive synthesis of existing industry-standard Web browser technology with 
script language interpreter extension technology. Although widgets are developed 
specifically for use as extensions to a particular scripting language the base to support 
development of such applications is small compared with the base to support 
development of plug-in applications. Thus, the present invention allows script based 
applications to tap into the vast pool of functional resources provided by web-browser 
plug-in applications. 

According to one aspect of the invention, plug-in extension code includes 
code for parsing a program script to detect an embed command, for fetching an object 



referenced by the embed command, and simulating a web-browser interface to 
automatically invoke a web-browser plug-in identified by the data format of the object. 

According to another aspect of the invention, the plug-in interface allows 
web-browser plug-ins to be used by the script-based application as embedded widgets. 

According to another aspect of the invention, the plug-in interface allows 
the plug-in application to interactively display and manipulate the object in a child 
window controlled by the script-based application. 

According to another aspect of the invention, the object if fetched using 
standard internet protocols such as http or file access. 

According to another aspect of the invention, the interpreter extension 
mechanism provides for late binding of code and application data. 

Other features and advantages of the invention will be apparent in view of 
the following detailed description and appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a layer diagram of a preferred embodiment of the invention; and 
Fig. 2 is a block diagram of a standard computer system. 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 

A preferred embodiment will now be described that utilizes the Tool 
Command Language and Tool Kit (Tcl/Tk) which is scripting language useful for 
WWW-based applications. Tcl/Tk was developed by John Ousterhout and is described in 
his book entitled, Tel and the Tk Toolkit, Addison- Wesley, ISBN 0-201-63337-X, 1994. 
However, the invention is generally applicable to any scripting language such as, for 
example, Perl, Python, Rexx, or Visual Basic. 

In a preferred embodiment, an extension to a scripting language simulates 
a browser from the point of view of a plug-in, in order for the plug-in to be embeddable 
within a script program interface, and manipulable in a manner similar to a native widget. 
Program code in the extension provides the same functions and interfaces to a plug-in as 
provided by an industry-standard Web browser application programming interface (API). 
From the plug-in' s viewpoint, the extension appears to be a conventional Web browser. 
Data objects are referenced in "SRC" parameters in the scripting language command 
syntax. These data files are fetched at run time using standard Web protocol conventions 



5 

(e.g.: http or file access). The script text file is parsed by the script interpreter at run time 
to identify language commands. A new script command is created which mimics a 
standard hypermedia embed text format. This command then causes the plug-in-interface 
extension to invoke code in the extension that allows the browser plug-in to be 
5 automatically invoked in order to allow display and interaction with embedded objects, 
whereby those embedded objects are treated by the scripting language platform as 
interactive widgets which can be embedded within the script program graphical user 
interface. 

One embodiment of the invention employs a "wrapper" utility, written in 
10 the script language, which defines a procedure which is able to parse and respond to an 
embed text format (an EMBED tag) which may be copied from a conventional HTML 
page and pasted into a program script. The wrapper utility procedure does this by parsing 
the EMBED tag, fetching the file defined by the "src=" attribute of the tag, and invoking 
the plug-in extension, while passing any associated EMBED tag parameters to the plug-in 
15 as passed arguments via the script language's argument passing mechanism. 

Fig. 1 is a layer diagram of a preferred embodiment of the invention. The 
upper block 10 of Fig. 1 represents a standard scripting language configuration including 
a user-interaction interface, script-based program, script interpreter, and extension API 
Sub-blocks 12 and 14 represent different script interpreter plug-in 
20 extensions sub-blocks. Each sub-block includes a plug-in extension which simulates a 
web-browser interface to the browser plug-in application and also allows the plug-in 
application to interactively control and manipulate the fetched object in window 
controlled by the script-based program. 

The following is a list of API functions simulated by the plug-extension in 
25 a preferred embodiment to simulate the plug-in interface of a Netscape web-browser: 



6 



Example Netscape browser plug-in API functions to be simulated: 

#ifdefXPJJNIX 

NPError NPN_GetValue(NPP instance, NPNVariable variable, void *value); 
5 #endif/* XPJJNIX */ 

void NPNJVersion(int*plugin_major, int*pluginjxiinor, 

int*netscape_major, int* netscapejninor); 
NPError NPN_GetURLNotify(NPP instance, conist char* url, 
const char* target, void* notifyData); 
10 NPError NPNJ3etURL(NPP instance, const char* url, const char* target); 

NPError NPN_PostURLNoIify(NPP instance, const char* url, 

const char* target, uint32 len, const char* buf, NPBool file, 
void* notifyData); 
NPError NPNJPostURL(NPP instance, const char* url, 
15 const char* target, uint32 len, const char* buf; NPBool file); 

NPError NPN_RequestRead(NP Stream* stream, NPByteRange* rangeList); 
NPError NPN__NewStream(NPP Instance, NPMIMEType type, const char* 

target, NPStream** stream); 
int32 NPN_Write(NPP instance, NPStream* stream, int32 len, void* 
20 buffer); 

NpError NPN_DestroyStream(NPP instance, NPStream* stream, NPReason 
reason); 

void NPN_Status(NPP instance, const char* message); 

const char* NPN__UserAgent(NPP instance); 
25 void* NPN_MemAlloc(uint32 size); 

void NPN__MemFree(void* ptr); 

uint32 NPN_MemFlush(uint32 size); 

void NPN_ReloadPlugins(NPBool reloadPages); 

JRIEnv*NPN_Get_JavaEnv(void); 
30 jref NPNJ3etJavaPeer(NPP instance); 



Function name Description 

35 NPN_GetValue Get a value 

NPNJVetsion Return the major & minor version 

Numbers for the Plugin protocol 

40 NPN__GetURLNotify Get a Stream URL and return 

the result via a call to NPPJJRLNotify 

NPN_GetURL Get data from a URL. 

45 NPN_PostURLNotify Post data to a server. 

NPN PostURL Post data to a server. 
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NPN_RequestRead 
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20 



40 



45 



NPN NewStream 



NPN Write 



15 NPNJDestroyStream 



NPN Status 



NPNJJserAgent 



25 

NPN__MemAlloc 
NPN__MemFree 
30 NPNMemFlush 

NPN_GetJavaEnv 
35 NW GetJavaPeer 



Request a range of bytes from 
a seekable stream to be sent 
to the plugin in subsequent 
NPP_Write calls, An fseek 
equivalent. 

Creates a new stream for data 
flow from plug-in to browser. 

Called from the plugin to write 
data to a stream created with 
NPN_NewStream. 

Destroy the stream created 
with the NewStream call. 

A line of text sent by the 
plugin to the browser, ostensibly 
to display on the 'status 5 line. 

Retrieves the User- Agent field 
from the Navigator. Just ship 
back a pro-defined string? 

Allocates memory, map to TclAlloc. 

Frees memory, map to TclFree. 

Frees memory in the browser to 
make more room for plugin. 

Returns the Java execution environment. 

Returns the plug-in associated 
with a Java object. 



Summary of basic system elements for a Tcl/Tk implementation. 

• A new set of Tel commands that load and operate plug-ins. Code in the plug-in- 
interface extension (a Tcl/Tk loadable extension, see Practical Programming in 
Tcl/Tk, by Brent B. Welch, 2nd Edition, pub: (1997) Prentice Hall; ISBN: 
0136168302 reference for Tcl/Tk extension API) provide the same functions and 
interfaces to a plug-in as provided by an industry-standard Web browser 

• Parsing code in the plug-in-interface extension allows the standard <EMBED.„> tag 
parameters to be passed as part of the Tel command call 

• Code in the plug-in-interface extension allows data objects referenced in "SRC" 
parameters to be fetched using standard conventions (e.g.: http or file access) 
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• Code in the plug-in-interface extension allows script to be parsed to identify embed 
text formats and to automatically invoke the browser plug-in application 

• Code in the plug-in-interface extension allows the plug-in application to be 
automatically invoked to allow display and interaction with embedded objects, 
whereby those embedded objects and their associated plug-in applications are treated 
by the scripting language platform as widgets. 

• Code in the plug-in-interface extension allows the plug-in application to display and 
provide interactive processing of a data and/or program object within a child window, 
said window which is embedded within a Tcl/Tk-controlled window, under control of 
the program script. 

The details of the implementation of a preferred embodiment are set forth 
in the source code appendix to this patent application. 

FIG. 2 is an illustration of basic subsystems of a computer system suitable 
for use with the present invention. In FIG. 2, subsystems are represented by blocks such 
as central processor 180, system memory 181 consisting of random access memory 
(RAM) and/or read-only memory (ROM), display adapter 182, monitor 183 (equivalent 
to display device 153 of FIG. 3), etc. The subsystems are interconnected via a system bus 
184. Additional subsystems such as a printer, keyboard, fixed disk and others are shown. 
Peripherals and input/output (I/O) devices can be connected to the computer system by, 
for example serial port 185. For example, serial port 185 can be used to connect the 
computer system to a modem for connection to a network or serial port 1 85 can be used 
to interface with a mouse input device. The interconnection via system bus 184 allows 
central processor 180 to communicate with each subsystem and to control the execution 
of instructions from system memory 181 or fixed disk 186, and the exchange of 
information between subsystems. Other arrangements of subsystems and 
interconnections are possible. 

The invention has now been described with reference to the preferred 
embodiments. Alternatives and substitutions will now be apparent to persons of skill in 
the art. In particular, the invention is applicable to all extensible scripting languages and 
is not limited to any particular set of existing scripting languages. The differences 
between scripting languages and system languages and the fundamental characteristics of 
scripting languages are set forth in an article by John Ousterhout entitled, Scripting: 
Higher Level Programming for the 21st Century, IEEE Computer Magazine . March, 
1998. 
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Further, although the preferred embodiment simulates the plug-in interface 
of a Netscape browser application, the nature of extensible scripting language allows the 
principles of the invention to be extended to any browser application. 

Accordingly, it is not intended to limit the invention except as provided by 
5 the appended claims. 



WHAT IS CLAIMED IS: 
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1 LA method for extending script language functionality utilizing web- 

2 browser plug-in applications, with the script language for implementing scripts defining 

3 interactive applications through run-time parsing and with the script language interpreted 

4 by an interpreter having standard application programming interfaces (APIs) for 

5 enhancing the command set and widget set of the interpreter through inteipreter 

6 extensions loaded at run-time, said method, implemented by a plug-in interpreter 

7 extension, comprising the steps of: 

8 parsing a program script to locate an embed command; 

9 parsing the embed command to locate a source reference and 

10 source format information; 

1 1 fetching an embedded object referenced by said source reference; 

12 automatically invoking a browser-plug in application based on the 

13 source format information; and 

14 creating a child window, controlled by the plug-in interpreter 

15 extension, to allow said plug-in application to display and interactively manipulate said 

1 6 embedded object. 



1 2. 



The method of claim 1 where said step fetching comprises: 



2 • utilizing a standard internet protocol to fetch the object. 



1 3. 
2 



A method for extending script language functionality utilizing web- 
browser plug-in applications, with the script language for implementing scripts defining 

3 interactive applications through run-time parsing and with the script language interpreted 

4 by an interpreter having standard application programming interfaces (APIs) for 

5 enhancing the command set and widget set of the interpreter through interpreter 

6 extensions loaded at run-time, said method, implemented by a plug-in interpreter 

7 extension, comprising the steps of: 

8 parsing a program script to locate an embed command; 

9 parsing the embed command to locate a source reference and 

1 0 source format information; and 

1 1 fetching an embedded object referenced by said source reference; 
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12 simulating a web-browser plug-in API to automatically invoke a 

13 plug-in application corresponding to said source format information; and 

1 4 creating a child window, controlled by the plug-in interpreter 

15 extension, to allow said plug-in application to display and interactively manipulate said 

16 embedded object. 

1 4. A computer program product comprising: 

2 a computer-readable storage structure for storing plug-in-interface 

3 extension program code for extending the functionality of a script interpreter platform by 

4 employing web-browser plug-in applications as components within script based 

5 programs, said program code comprising: 

6 parsing program code for causing a computer to parse the 

7 standard embed tag parameters to be passed as part of a scripting language command call; 

8 program code for causing a computer to fetch data objects 

9 referenced in "SRC" parameters standard conventions (e.g.: http or file access); 

1 0 program code for causing a computer to parse script to 

1 1 identify embed text formats and to automatically invoke the browser plug-in application 

12 to display and interact with embedded objects, whereby those embedded objects and their 

1 3 associated plug-in applications are treated by the scripting language platform as widgets. 

1 5. The computer program product of claim 4 where said plug-in- 

2 interface extension program code further comprises: 

3 program code for causing the computer to allow the plug-in 

4 application to display and provide interactive processing of a data and/or program object 

5 within a child window, said window which is embedded within a plug-in-interface 

6 extension -controlled window. 

1 6. The computer program product of claim 4 where said program 

2 code for causing a computer to fetch data objects further comprises: 

3 program code for causing the computer to fetch data objects 

4 utilizing internet data transfer protocols. 
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7. A method, performed by a computer, for extending the 
functionality of a script program interpreter by employing web-browser plug-in 
applications as components within script based programs, said method comprising the 
steps of: 

5 parsing standard embed tag parameters to be passed as part of a 

scripting language command call; 

fetching data objects referenced in "SRC" parameters standard 
conventions (e.g.: http or file access); and 

parsing script to identify embed text formats and to automatically 
10 invoke the browser plug-in application to display and interact with embedded objects, 
whereby those embedded objects and their associated plug-in applications are treated by 
the scripting language platform as widgets. 

8. A method for extending script language functionality utilizing 
web-browser plug-in applications, with the script language for implementing text scripts 

1 5 defining interactive applications through run-time parsing and with the script language 
interpreted by an interpreter having standard application programming interfaces (APIs) 
for enhancing the command set and widget set of the interpreter through interpreter 
extensions loaded at run-time, said method comprising the steps of: 

including a hypermedia-embed-text- format-mimicking command in a text 

20 script; 

parsing a text script at run-time to identify language commands; 
when said hypermedia-embed-text- format-mimicking command is 

identified: 

fetching an embedded object referenced by said hypermedia- 
25 embed-text-format-mimicking command; 

invoking a plug-in interface extension of the interpreter to 
automatically invoke a browser plug-in application associated with the embedded 
object; and 

utilizing the associated browser plug-in to display and interact with 
30 the embedded object in a window controlled by the text script. 
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METHOD AND SYSTEM FOR HYPERMEDIA BROWSER API SIMULATION 
TO ENABLE USE OF BROWSER PLUG-INS AND APPLETS AS EMBEDDED 
WIDGETS IN SCRIPT-LANGUAGE-BASED INTERACTIVE PROGRAMS 

ABSTRACT OF THE DISCLOSURE 
A system is described which provides the capability for high-level 
extensible scripting language interpreters to incorporate and employ Web browser plug- 
ins as components within script-based programs. A script interpreter extension is 
5 described which simulates the plug-in API interface of a Web browser, from the point of 
view of the browser plug-in, to allow program scripts to cause browser plug-ins to be 
launched and manipulated, in a manner similar to the scripting platform's native widgets, 
from within the executing program script. This system allows embedded external 
program objects to be used to display and enable interactive processing of embedded data 
10 objects. 
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Figure 1: A layer diagram of a typical implementation of the invention, using a scripting language platform 
such as Tcl/Tk- A script interpreter extension provides functions that mimic the browser-side interface of a 
Web browser plug-in API 
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are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code, and that such willful 
false statements may jeopardize the validity of the application or any patent issuing thereon. 
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Michael D. Doyle 
Date 


Date 


Date 
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